Quantification of hematoma and perihematomal edema volumes in intracerebral hemorrhage study: Design considerations in an artificial intelligence validation (QUANTUM) study.

BACKGROUND: Hematoma and perihematomal edema volumes are important radiographic markers in spontaneous intracerebral hemorrhage. Accurate, reliable, and efficient quantification of these volumes will be paramount to their utility as measures of treatment effect in future clinical studies. Both manual and semi-automated quantification methods of hematoma and perihematomal edema volumetry are time-consuming and susceptible to inter-rater variability. Efforts are now underway to develop a fully automated algorithm that can replace them. A (QUANTUM) study to establish inter-quantification method measurement equivalency, which deviates from the traditional use of measures of agreement and a comparison hypothesis testing paradigm to indirectly infer quantification method measurement equivalence, is described in this article. The Quantification of Hematoma and Perihematomal Edema Volumes in Intracerebral Hemorrhage study aims to determine whether a fully automated quantification method and a semi-automated quantification method for quantification of hematoma and perihematomal edema volumes are equivalent to the hematoma and perihematomal edema volumes of the manual quantification method. METHODS/DESIGN: Hematoma and perihematomal edema volumes of supratentorial intracerebral hemorrhage on 252 computed tomography scans will be prospectively quantified in random order by six raters using the fully automated, semi-automated, and manual quantification methods. Primary outcome measures for hematoma and perihematomal edema volumes will be quantified via computed tomography scan on admission (<24 h from symptom onset) and on day 3 (72 ± 12 h from symptom onset), respectively. Equivalence hypothesis testing will be conducted to determine if the hematoma and perihematomal edema volume measurements of the fully automated and semi-automated quantification methods are within 7.5% of the hematoma and perihematomal edema volume measurements of the manual quantification reference method. DISCUSSION: By allowing direct equivalence hypothesis testing, the Quantification of Hematoma and Perihematomal Edema Volumes in Intracerebral Hemorrhage study offers advantages over radiology validation studies which utilize measures of agreement to indirectly infer measurement equivalence and studies which mistakenly try to infer measurement equivalence based on the failure of a comparison two-sided null hypothesis test to reach the significance level for rejection. The equivalence hypothesis testing paradigm applied to artificial intelligence application validation is relatively uncharted and warrants further investigation. The challenges encountered in the design of this study may influence future studies seeking to translate artificial intelligence medical technology into clinical practice.

Fully Automated Segmentation Algorithm for Perihematomal Edema Volumetry After Spontaneous Intracerebral Hemorrhage.

Background and Purpose- Perihematomal edema (PHE) is a promising surrogate marker of secondary brain injury in patients with spontaneous intracerebral hemorrhage, but it can be challenging to accurately and rapidly quantify. The aims of this study are to derive and internally validate a fully automated segmentation algorithm for volumetric analysis of PHE. Methods- Inpatient computed tomography scans of 400 consecutive adults with spontaneous, supratentorial intracerebral hemorrhage enrolled in the Intracerebral Hemorrhage Outcomes Project (2009-2018) were separated into training (n=360) and test (n=40) datasets. A fully automated segmentation algorithm was derived from manual segmentations in the training dataset using convolutional neural networks, and its performance was compared with that of manual and semiautomated segmentation methods in the test dataset. Results- The mean volumetric dice similarity coefficients for the fully automated segmentation algorithm were 0.838±0.294 and 0.843±0.293 with manual and semiautomated segmentation methods as reference standards, respectively. PHE volumes derived from the fully automated versus manual (r=0.959; P<0.0001), fully automated versus semiautomated (r=0.960; P<0.0001), and semiautomated versus manual (r=0.961; P<0.0001) segmentation methods had strong between-group correlations. The fully automated segmentation algorithm (mean 18.0±1.8 seconds/scan) quantified PHE volumes at a significantly faster rate than both of the manual (mean 316.4±168.8 seconds/scan; P<0.0001) and semiautomated (mean 480.5±295.3 seconds/scan; P<0.0001) segmentation methods. Conclusions- The fully automated segmentation algorithm accurately quantified PHE volumes from computed tomography scans of supratentorial intracerebral hemorrhage patients with high fidelity and greater efficiency compared with manual and semiautomated segmentation methods. External validation of fully automated segmentation for assessment of PHE is warranted.